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Business,  government  and  other  non-profit  organisations  need  measures 
of  how  well  products  and  service  are  meeting  client  needs  and  wants  so  that 
they  'can  enhance  their  cm   and/or  society's  well  being.   The  extent  to  which 
these  needs  and  grants  are  met  has  corns  to  be  called  [Hunt,  1975]  consumer 
satisf a-cvion/dis  ;>_?  cis  ^action  (CS/D),  a  tern  preferable  to  alternatives  such 
as  happiness/unhappino'j.3  since  it  specifically  implies  the  satisfaction  of 
specific  needs  and  wants.   Thus,  there  is  now  considerable  theoretical  and 
empirical  interest  in  the  question  of  hew  one  ought  to  measure  consumer  satis- 
faction/dissatisfaction [Leavitt,  1975;  Hunt,  1975;  Warland,  Herrmann  and 
Willitts,  197*+;  Day,  1975],   The  purpose  of  this  paper  is  to  offer  a  taxonomy 
of  possible  CS/D  measures  and  to  present  data  from  a  recent  national  field 
study  on  the  consequences  of  using  alternative  definitions. 

WHAT  TO  MEASURE 

The  questmen  of  hew  one  can  and  ought  to  measure  CS/D  depends  on  the 
<  nsvrer  to  three  q>'3sti<->nn: 

1.  What  .are  your  goais?  Do  you  wish  to  maximize 
satisfactions  or  just  minimize  dissatisfactions? 

2.  Are  individuals  to  re  allowed  to  define  their 
own  Jit isf action  or  dissatisfaction  or  is  some 
objective  measure  preferred? 

3.  At  what  poinr  in  the  purchase  process  do  you 
wish  to  measure  consumer  satisfaction  or 
dissatisfaction,  soon  after  the  purchase  or 
after  possible  compJaints  have  been  resolved? 


1 
Happiness  is  also  postulated  to  be  a  more  enduring  sratus  not  related 

to  specific  instrumental  activities. 


Satisfaction  or  Dissatisfaction? 

Cleanly,  it  is  in  the  ■''nterest  of  society  and  individual  businesses 
to  maximize  consumer  satisfaction.   However,  one  may  choose  rather  to 
minimize  dissatisfaction  on  either  philosophical  or  practical  grounds. 
The  philosophical  issue  is  most  critical  for  government  agencies  who  may 
feel  that  their  role  ought  to  be  one  of  minimizing  abuses  in  the  marketplace, 
of  protecting  consumers  from  serious  calamities  from  which  they  realistically 
cannot  protect  themselves.   This  would  lead  to  an  objective  of  minimizing 
dissatisfactions.  Minimizing  dissatisfactions  may  also  be  chosen  for  prac- 
tical reasons.   As  we  shall  note  below,  maximizing  satisfaction  is  an  elusive 
goal.   It  is  difficult  to  conceive  of  ever  making  all  people  fully  satisfied, 
and  it  does  seem  at  least  feasible  to  achieve  a  level  of  product  and  service 
performance  free  of  "defects." 

Objective  or  Subjective  Measure? 

The  second  question  of  whether  an  individual  should  be  allowed  tr 
define  his  or  her  ovm  level  of  satisfaction  raises  the  subjective/objective 
issue  promir.  ;nt  in  the  social  indies  :ors  literature  [cf.   Andrews  and 
Withey,  13741.   In  simplest  terms,  the  question  is:  should  one  simple  ask 
people  for  measures  of  how  well  they  feel  they  were  satisfied  by  a  given 
purchase  or  should  one  develop  an  objective  measure  of  purchase  performance 
which  is  largely  uninfluenced  by  personal  idiosyncracies.  The  problems 
with  sub j  ect ive  measures  are  several : 

a.  Since  they  are  psychological  constructs,  there  is  great 
potential  for  measurement  and  response  bias; 

b.  As  affective  states,  they  may  be  unreliable  due  to  the 
influence  of  situational  factors; 

c.  There  are  significant  aggregation  problems;  i.e.,  what 
one  consumer  means  by  "somewhat  satisfied"  may  not  be 
the  same  as  what  another  means  by  the  same  term. 


d.  It  is  very  likely  that  subjective  satisfaction 
measures  may  be  negatively  correlated  with  social 
status;  thus  if  consumer  responses  are  equally 
weighted,  the  use  of  subjective  measures  may 
have  the  perverse  effect,  for  example,  of 
diverting  company  or  governmental  resources  to 
the  upper  class  consumer  who  is  distressed  that  . 
he  can  hear  the  clock  on  his  Rolls  Royce  actually 
ticking  away  from  the  disadvantaged  consumer  who 
is  pleased  that  his  used  car  lasted  twice  the 
length  of  the  warranty  period  before  the  engine 
block  cracked. 

e.  It  is  also  likely  that  subjective  satisfaction  may 
be  negatively  associated  with  past  satisfaction,  i.e. 
that  as  one  is  satisfied,  one  raises  one's  internal 
standards.  This,  in  its  turn,  has  the  perverse  effect 
that  as  satisfaction  increases  on  an  absolute  scale, 
measures  of  subjective  satisfaction  may  actually  increase  I 


First  or  Final  Satisfaction? 

It  is  clear  that  there  are  two  critical  points  in  the  post-purchase 
satisfaction  process  at  which  one  can  measure  CS/D.  This  is  made  clear 
in  a  simplified  description  of  the  post-purchase  satisfaction  process 
presented  in  Figure  1.  Here  one  can  see  that  dissatisfaction  with  a 
product  or  service  can  occur  because  the  consumer  believes  it  has  not 
lived  up  to  expectations,  either  something  has  specifically  gone  wrong  or 
the  purchase  just  "hasn't  measured  up."  (This  is  a  distinction  we  shall 
return  to  below.)  One  can,  of  course,  scale  this  initial  reaction.  The 
problem  with  such  a  measure,  particularly  as  it  might  be  used  by  govern- 
mental agencies,  is  that  it  clearly  ignores  sellers'  complaint  handling 
mechanisms.   It  may  well  be  that  a  very  substantial  number  of  consumers  will 
have  the  source  of  their  initial  dissatisfaction  resolved  by  such  mechanisms, 
Thus,  in  some  contexts,  what  we  shall  term  final  satisfaction  may  be  the 
preferred  measure  since  it  adjusts  initial  dissatisfaction  by  subsequent 
satisfactions. 


Figure  1  about  here 

HOW  TO  MEASURE  CS/D 

The  above  discussion  suggests  eight  possible  approaches  to  the  scaling 
of  CS/D  depending  on  whether  the  measure  is  (a)  of  satisfaction  or  dissatis- 
faction ;  (b)  objective  or  subjective;  and  (c)  initial  or  final.   There  are, 
of  course,  important  additional  questions  to  be  asked  in  the  preparation  of 
a  specific  study  plan.  Among  the  most  critical  of  these  is  that  of  the  level 
of  purchase  category  aggregation  for  which  the  measure  will  be  taken.  The 
latter  question  will  not  be  our  concern  here,  although  the  paper  does  report 
data  at  a  rather  general  level  of  aggregation  below.  We  will  now  turn  to  a 
description  of  several  possible  scales  appropriate  to  each  of  the  eight 
categories. 


Figure  2  about  here 

Maximizing  Satisfactions 

1.   Initial  subjective  satisfaction:   Here  a  simple  scale  of  satis- 
faction with  a  given  purchase  category  may  be  administered.  This 
is  perhaps  the  most  frequently  used  technique.  A  typical  approach 
is  that  of  Handy  and  Pfaff  [1975]  who  use  a  five  point  initial 
subjective  satisfaction  scale  ranging  from  "always  satisfied"  to 
"never  satisfied."  This  scale  and  the  four  point  scale  which 
will  be  discussed  further  below  [Best  and  Andreasen,  1976]  have 
not  been  tested  for  validity  and  reliability.   Further,  they  make 


2 
Actually  seven  since,  as  will  be  noted  below,  I  could  not  think 

of  a  measure  of  initial  objective  satisfaction. 


no  allowance  for  consumers'  lack  of  knowledge  and  interest  in 
the  purchase  category.  A  scale  that  does  meet  these  requirements 
developed  by  Andrews  and  Witney  [1974]  is  reproduced  in  Figure  3. 
This  scale  has  not  been  used  in  consumer  studies  to  date. 


Figure  3  about  here 

As  an  alternative  to  this  time-consuming  procedure,  several 
researchers  ask  respondents  not  to  scale  each  purchase  or  purchase 
category  but  to  rank  the  categories  or  some  subjective  initial 
satisfaction  criterion.   An  example  of  this  approach  is  found  in 
Day  and  London  [1975]  who  ask  their  respondents  to  report  purchases 
that  were  "most  satisfactory"  and  "least  satisfactory." 

Finally,  it  should  be  noted  that  at  least  some  firms  rely 
not  on  the  subjective  opinions  of  consumers  but  on  the  opinions 
of  salesmen  or  middlemen  to  ascertain  how  well  their  products  and 
services  are  performing  [McNeal,  1969]. 

The  problem  with  these  scales  is,  of  course,  that  they  are 
subjective.  And  thus  they  have  the  problem  of  response  bias, 
aggregation,  and  so  on  described  earlier.   One  problem  in  over  time 
measurements  is  the  difficulty  of  separating  changes  in  expectations 
from  changes  in  performance.   Kotler  has  proposed  a  procedure  for 
monitoring  these  effects  separately  with  what  he  calls  a  derived 
dissatisfaction  measure  [1975,  pp.  155-6].   A  sample  scale  adapted 
from  Kotler  is  reproduced  in  Figure  4.   The  scale,  however,  still 
retains  the  problems  of  bias,  reliability,  and  aggregation  discussed 
earlier. 


Tigure  4  about  here 


Both  Kotler  and  Andrew  and  Withey's  scales  are  unidimensional. 
This  need  not  be  the  esse.   Cognitive  processing  modellers  have 
pointed  out  that  consumers  evaluate  purchase  alternatives  along 
several  dimensions.   It  may  be  that  in  certain  cases  policy  makers 
may  wish  to  near.ure  satisfaction  (or  derived  dissatisfaction)  along 
several  dimensions.   Such  disaggregation  may  yield  important 
insights  into  the  workings  of  cognitive  processes  described  in 
Figure  1.   An  obvious  place  to  begin  would  be  correlation  studies 
predicting  general  affective  scores  such  as  those  derived  from 
Andrew  and  Withey's  or  Kotler's  scales  from  multidimensional 
satisfactions  data. 

Final  Subjective  Satisfaction.   As  noted  in  Figure  1,  whether  or 
not  a  source  of  dissatisfaction  is  ever  removed,  even  partially, 
depends  on  two  thin&f.9  first  whether  the  consumer  brought  the 
problem  to  the  attention  of  the  seller  and,  second,  whether  the 
response  of  the  seller  was  perceived  by  the  consumer  to  bo  satis- 
factory or  not.   It  is  3 ikely  that  whether  the  problem  is  mentioned 
to  *  he  seller  will  be  a  fun  tion  of  both  the  seriousness  of  the 
problem  as  perceived  by  the  consumer  and  whether  the  consumer 
expect:-  the  complaint  process  to  be  satisfactory.   The  latter  in 
turn  may  be  a  function  of  the  consumer's  own  character is itcs 
(such  as  his/her  perceived  locus  of  control  [Landon  and  Emery, 
undated])  as  well  as  the  consumer's  beliefs  about  the  company's 
complaint  handling  performance. 

The  specific  measure  for  final  subjective  satisfaction  would 
then  involve  modifying  initial  subjective  satisfaction  scores  to 
incorporate  satisfactory  con.olaint  handling  experiences.   As  with 
"derived  dissatisfaction"  scores,  some  of  the  subjectivity  could 


be  monitored  by  asking  for  separate  data  on  consumer's 
expectations  regarding  the  complaint  handling  process. 
Initial  Objective  £     •  J^£i°nt  No  measure  has  been  developed. 
Final  Objective  Satisfaction;  Business  has  for  ^ome  time  argued 
that  the  ultimate  test  of  whether  a  product  or  service  has  been 
imsatisfactory  has  been  that  product  or  service's  sales  or  market 
share.   Indeed,  after  consumer  research  and  unsolicited  complaints, 
these  measures  were  found  by  McNeal  to  be  the  two  measures  most 
frequently  used  by  business  to  measure  consumer  satisfaction  in 
the  late  1960 's  [McNeal,  1969].  The  problem  with  sales  measures, 
however,  is  that  they  are  affected  by  so  many  marketing  factors 
that  a  decline  in  sales  due  to  dissatisfaction  of  past  customers 
with  the  purchases  may  be  masked,  for  example,  by  customers 
switching  in  from  other  brands  due  to  differences  in  marketing  mi:' 
among  firms  (price,  promotion,  etc.).  This  problem,  of  course, 
could  be  overcome  if  customer  level  sales  data,  say  from  a  consumer 
panel,  was  collected  on  repeat  purchases  only.  This  measure, 
however,  is  still  subj  >d  j<3  to  intercompany  competitive  differences, 
~t   is  also  not  a  v*ry     stive  measure  in  cases  of  products  with 
long  repurchase  cycles  since  such  repeat  behavioi  will  be  highly 
subject  to  non-performance  influences.  Repeat  sales  data  on 
products  with  long  repurchase  cycles  also  have  the  disadvantage 
that  they  usually  ccmij  too  late  for  timely  remedial  action. 


Minimizing  b is sat_if fact i on 

One  can,  of  course,  in  the  case  of  the  simple  subjective  measures 
described  ab'-ve  take  only  the  negati/e  "half"  of  the  scale — i<e.,  the 
dissatisfactions — and  be'- 2  p  )licy  on  these  measures.  The  deficiencies 
of  such  measures  have  already  bee.i  discussed. 

An  alternative  set  of  measures  proposed  for  dissatisfactions  is  that 
comprising  what  are  called  conr.u^er  complaints  data.  Companies  as  well  as 
federal  agencies  for  some  tine  have  been  using  unsolicited  data  of  this  kirJ 
in  policy  decisions  [cf.  Diener,  1975]  and  more  recently  several  researchers 
including  the  author  (with  Arthur  Best)  have  been  seeking  data  directly  from 
consumers  on  their  product  and  service  problems.  These  measures  of  dissatis- 
faction have  as  a  principal  advantage  that  they  provide  inf ormation  on  the 
specific  sources  of  dissatisfaction  within  purchase  categories,  something 
that  only  the  multidimensional  subjective  satisfactions  measles  can  para.il.., 
(ac:  a  much  greater  cost  and  likely  greater  inaccuracy). 

5.   Initial  Subjective  Dissetisf action:   The  simplest  "complaint 
data"  sca1e  that  cne  might  use  is  the  frequency  with  which 
consumer:;  mention  having  a  •  ^icific  problem  with  regard  to 
a  product  or  service  categories.   This  may  be  further  narrowed 
to  eliminate  price  complaints  wl    we  have  found  are  quite 
prominent  in  cert.-  .  sategerier  Ce.g.  ,  food)  in  periods  ai 
serious  inf la  i 

General  complaint  measures  are  classified  in  this  taxonomy 
as  subjective  since  a  substantial  number  of  them  involve 
judgmental  matters  (e.g.  "badly  designed,"  "poor  stitching," 
and  so  forth). 


They  ares  therefore,  like  other  subjective  measures  responsive 
to  changes  in  consumer  expectations,  market  sophistication,  and 
so  forth. 

A  further  issue  with  respect  to  these  data  is  whether  one 
should  measure  what  we  have  called  "complaints"  or  "problems . ,T 
Complaints  are  those  problems  voiced  to  business  or  official 
complaint  handling  agencies  (whet  McNeal  calls  "unsolicited 
complaints").  Measures  •  f  these  complaints  have  two  advantages. 
First,  since  they  represent  a  specific  document  they  eliminate 
the  response  bias  problems  (memory,  yeasaying,  etc.)  of  direct 
consumer  measures.  Second,  they  arc  already  routinely  catalogued 
by  most  businesses  and  government  agencies. 

The  argument  for  problem  measures  on  the  other  hand  is  that 
several  studies  have  shown  that  complaints  come  from  an  unrepresen- 
tative sample  of  the  population.  Unfortunately,  as  Day  notes  [1975}, 
what  ha?  not  heretofore  been  tested  is  whether  complaints  data  are 
unrepresentat ive  of  problems  data.  Clearly,  if  the  former  substan- 
tially parallel  the  latter  the  cost  of  collecting  the  latter  would 
not  be  justified.   This,  also,  is  an  issue  we  shall  turn  to  below. 

**•   Subjective  Final  Dissatisfactions;  Just  as  initial  satisfactions 
data  can  be  modified  by  satisfaction  with  complaint  handling  pro- 
cesses, so  can  initial  complaint  or  problem  measures  be  reduced  by 
subsequent  satisfactory  complaint  handling. 

7.   Objective  Initial  Dissatisfactions;   It  was  noted  that  some  problems 
were  in  fact  subjective.   It  is,  of  course,  not  true  that  all  pro- 
blems are  subjective.   The  lateness  of  shipments  for  special  orders, 
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the  frequency  with  which  warranty  claims  are  made  for  partial 
or  complete  breaKage  and  the  frequency  of  billing  errors  not  in 
the  customer's  favor  are  or 'ective  measures  which  companies  can 
collec:  internally.  These  are  also—subject  to  random  memory 
loss~-the  kinds  of  problems  consumers  ought:  to  report  reasonably 
accurately  vr      surveys  of   cc       >roblems.   It  may  therefore 
be  ireful  to  distxn  (uish  "objective'  problem  data  in  such  studies 
from  all  problem  data.   L'his,  too,  is  •-  shall  report  on 

beJc*. 
8.  Objective  Final  Dissatisfaction:   Given  that  warranty  and  related 
complaints  virtually  always  are  attended  to  by  businesses,  one 
would  need  specific  survey  data  to  tell  to  what  extent  such  "objec- 
tive" complaints  were  ultimately  resolved  to  the  consumer's  satis- 
faction. An  alternative  objective  measure  would  be 
data  en  consumers  who  do  not  repurchase  a  particular  item.  As 
noted,  such  data  would  only  possibly  be  useful  for  a  limited  numt  r 
of  purchase  categories. 

It  was  noted  in  th*  discussion  E:bcve  that  some  of  the  proposed  measures 
are  clearly  easier  to  collect  thai  ethers,   Implicit  in  1    r  cussion  the: 
is  the  question  of       '  all  $    1  :  -r   measures-  of  them-- 

tend  to  give  the  same  results.   Data  from  a  recent  study  by  3esL"  and 
Andreasen  [1976]    lit  preliminary  c       i  of  this  ques 

The  study  contacted  an  urban  sample  of  2419  households  in  34  cities. 

Each  household  was  qus  -   about  problems  wi1     :hases  in  3M  relatively 

broad  product  and  service  catego  Les.  Thi      -  ;  .    on  28^500  purchases, 
about  8000  of  which  had  sie  kind  of  perceived  problem. 
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The  study  provided  four-  kinds  of  data  relevant  for  this  analysis: 

a.  Subjective  initial  satisfactions  data 

b,  Problems  data 

Complaints  (voiced  problems)  data 
d.  Data  on  satisfactions  with  i  i  jlainx  handling  processes 
Since'  the  problems  data  could  be  further  partioned  into  "subjective"  and 
"objective''  problems h   scales  ;an  be  derived  to  fit  four  of  the  cells  in 
the  CS/D  taxonomy  just  described.  Data  on  these  scales  for  10  of  the  34 
purchase  categories — seven  products  and  three  services— are  presented  in 
Tables  1  through  3.  Tha  ten  categories  were  chosen  to  represent  the  range 
of  results  in  the  study t  to  minimize  interpretative  problems  in  some  cate- 
gories., and  to  ensure  that  each  category  was  large  enough  (i.e..  had  at  least 
twenty-five  complaints  resolved). 

The  data  presented  in  the  Tables  are  index  scores  and  rankings  of  the 
ten  purchase  categories.  They  are  designed  to  answer  the  question:  which 
purchase  category  does  best  or  worst  in  meeting  consumer  needs  and  wants 
according  to  the  various  definitions.  Thus,  they  provide  information  on 
relative  no  ubsoltite  performance  a  though  in  a  few  Cc  >es  differences  in 
absolute  levels  across  scales  will  be  noted.  The  Tables  provide  data  on 
four  cells  in  Figure  2.  We  be^xn  ;ith      >le  measure  of  initial  subjec- 
tive satisfaction,  then  |       tve  sets  of  data  for  initial  end  subjective 
dissatisfaction,  one  set  of  data  on       L  "objective"  dissatisfaction  f 
the  seven  products  only,  two  set*  of  dat     dissatisfaction  with  complaint 
handling  processes  and.  finally,  a  composite  final  dissatisfaction  measure. 
Since  only  one  set  of      epcrts  satisfactions  data,  these  data  will  be 
cast  in  the  negative  (i.e.,  as  dissatisi     ns)  for  comparability  with  the 
remaining  data. 
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Satisfactions  and  Problems 

The  first  pair  of  columns  in  Table  1  report  index  scores  and  rankings 
of  the  ten  p  'rchase  categories  usinf  a  simple  four  poirt  satisfaction  scale. 
Respondents  whose  household  had  purchased  in  the  product  category  were  simply 
asked  whether  the  purchase  was  "satisfactory,  somewhat  satisfactory,  somewhat 
unsatisfactory,  or  unsatisfactory."  This  therefore  may  be  classified  as  an 
initial  subjective  satisfaction  meanure,   However,  as  noted  earlier,  to  per- 
mit comparison  with  the  remaining  data,  the  results  were  cast  in  the  negative. 
Thus,  the  indexes  are  based  upon  the  proportion  of  respondents  reporting  their 
purchase  as  "somewhat  unsatisfactory"  or  "unsatisfactory."  As  the  rankings 
indicate,  the  three  repair  services  are  clearly  the  poorest  perforners  using 
this  measure  vnile  bicycles,  television  sets*,  calculators  and  tires  are  the 
best . 

Table'  l"  about  here 

The  next  set  of  columns  report  a  measure  of  the  frequency  with  which 
consumers  reported  non-price  problems  with  their  purchases,  a  measure  of 
initial  subjective  dissatisfaction  r  "nee  many  of  the  problems,  as  we  shall 
note  below,  were  judgmental.  The  raw  data  for  this  scale  are  different  from 
the  satisfaction  measures  in  the  first  columns  in  two  important  respects. 
First,  it  was  found  that  when  asked  how  the  purchase  could  have  been  better 

eighteen  percent  of  the  respondents  who  indicated  they  were  "somewhat 
satisfied"  or  "satisfied"  with  purchases  in  these  ten  categories  report, 
problems  essentially  similar  to  those  who  were  dissatisfied  with  their  pur- 
chase. Thus,  in  this  sense  the  simple  initial  satisfaction  scales  underr . ~ 
absolute  levels  of  consumer  dissatisfaction. 
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Second,  :;  ^  was  found  that  "hen  the  type  of  problem  was  investigated,  the 
sola  problem  in  fourteen  percent  of  the  purchases  was  that  "it  cost  too  much." 
While  it  may  be  desirable  in  other  c  rcumstances  to  iroi.it or  consumer's  reac- 
tions to  the  prices  thav  pay,  such  reactions  are  likely  to  be  more  sensitive 
to  inflationary  pressures  thai  to  either  governmental  or  business  product/ 
service  improvement  programs.   In  this  second  sense,  then,  overall  satisfac- 
tion/dissatisfaction  scales  tend  to  overreport  the  absolute  level  at  which 
consumers '  needs  and  wants  are  unmet . 

When  the  frequency  with  which  purchases  involve  perceived  non-price 
problems  is  computed,  there  are  important  shifts  in  the  rankings  from  Column 
1.  In  general,  car  repair  purchases  tend  to  fare  badly  and  television  sets, 
calculators  and  tires  continue  to  do  well.  The  index  score  for  car  pur- 
chases, however,  increases  significantly  making  it  the  second  worst  offender 
by  "his  criterion.   Index  values  for  bicycles  and  toys  also  increase  while 
hone  repairs  decline  somewhat  and  appliance  repairs  decline  significantly. 
The  latter  is  partly  due  to  the  fact  that  appliance  repair  dissatisfactions 
relatively  more  often  involve  price-only  complaints. 

Voiced  Complaints 

Since  ur.eolioited  complaints  data  are  routinely  catalogued  by  many 
businesses  and  thus  could  eai       made  the  basis  of  a  low  cost  CS/D 
monitoring  syi  :em,  an  important  questior  is:  do  these  complaints  accurately 
reflect  problems  in  the  marketplace  given  that  we  know  that  those  who  voice 
complaints  are  not  representative  of  all  those  with  problems  [Warland, 
Herrmann  and  Willits,  :97iJ'j?  There  are  two  dimensions  to  this  question. 


Price  is  much  more  often  a  problem  mentioned  for  service  ^ategori 
where  the  response  may  be  less  often  a  reflection  of  inflation  and  may  aven 
be  a  surrogate  for  poor  performance. 
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First,  one  could  ask  whether  the  index  numbers  and  ranks  of  purchase 
categories  is  the  same  for  voiced  complaints  data  as  fox  non-price  problems 
data.   If  the  indexes  are  the  same,  unsolicited  complaints  would  be  valid 
indicators  of  the  relative  performance  of  various  categories  and,  given  an 
estimate  of  uhe  rate  at  which  complaints  are  voiced  to  sellers,  would  also 
yield  aa  estimate  ot  the  at*- n) u  -  Leva]    performance  across  categories. 
The  second  issue,  which  w«  will  not  investigate  here,  is  whether  the  type 
of  complaint  voiced  is  representative  of  all  problems  consumers  perceive. 
If  it  is  representative,  unsolicited  complaints,  even  chough  not  indicative 
of  overall  relative  or  absolute  performance,  could  pinpoint  arees  where 
improvements  could  be  effected. 

Differences  between  the  second  and  third  sets  of  columns  in  Table  i 
essentially  reflect  the  differences  in  the  frequency  with  which  consumers 
fcct  on  problems  they  perceive  in  the  category.   Respondents  were  more  likely 
to  contact  sellers  about  repair  problems,  especially  home  repairs,  and  car 
and  television  purchases  and  much  less  likely  to  voice  problems  with  respect 
to  toys.   One  obvious  inference  to  be  drawn  from  this  is  that  the  voicing  of 
problems  may  well  be  a  function  of  the  expensivenesa  of  the  purchase.  Thus. 
unsolicited  complain*?  date  may  be  considered  effective  measi     ~  problems  in 
relatively  expensive  categories  and  less  ei  ve  in  inexpensive  categories. 

Alternatively,  one  may  c-  si<  -r   unsolicited  complaints  as  Indexes  of  problems 
weighted  by  importance .     is,  1    rer,  also  possible  that  these  scores  may 
reflect  the  consumers'  beliefs  about  tl    ~:.onsiyaness  of  sellers  in  the 
category.  Thus,  the  issue  of  the  usefulness  of  these  data  still  remains 
unclear. 


14. 
The  "voiced  non-price  problems'5  column  was  computed  by  comparing 

complaints  voiced  to  sellers  or  official  third  parties  to  total  purchases. 
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"Objective"  Problems 

The  final  set  of  data  in  Table  1  represents  an  attempt  to  grapple  wi4-"-! 
the  difficul  ies  of  scaling  "object i  e"  problems  from  cor  date.   In  many  of 
the  purchase  categories  under  3tudy  here,  consumers  reported  such  problems 
as  "should  be  easier  to  use,"  "doesn't  last  long  enough,"  "repaired  sloppily," 
"was  misrepresented,"  and  so  on,   In  each  of  these  cases,  it  is  clear  that 
the  problem  may  be  a  mattez  of  iriosyncratic  personal  judgment.   This  per- 
sonal judgment  may  be  highly  related  to  expectations,  which  in  turn  may  be 
a  function  of  income,  education,  and  so  on.   Two  observers  thus  may  not 
Loth  see  the  same  evidence  as  a  "problem."  To  eliminate  this  source  of  bias, 
a  separate  count  was  made  of  th^  frequency  with  which  consumers  reported 
problems  of  the  following  types: 

partially  or  totally  broken 
wrong  product  or  service  provided 
customer's  property  lost 
slow  or  not  delivered 
clerical  error 

These  classifications  shall  be   defined  as  "objective  problems"  in  the  sense 
that  two  observers  ought  to  come  to  the  same  conclusion  from  the  evidence 
that  a  "problem"  exists.  Unfortunately,  they  are  classifications  that  are 
hard  to  apply  t.     dees.  "     Table  1  only  ranks  the  seven  product  pur- 
chases— and  to  ease     arability  assun      t  the  services  would  be  ranked 
1,  2  and  3. 

Comparing  column  2  and  column  fr,  we  can  see  that  television  sets  and 
automobile  purchac-es  have  high  tencies  of  objective  problems.  On  the 
other  hand,  eyeglass  problems  apparently  are  much  more  subjective  in 
nature.  One  Is  forced  to  conclude,  however,  that  although  these  data  may 
be  more  objective  in  character,  they  are  at  this  point  probably  more  sen- 
sitive to  present  definitions  and  coding  schemes.  This  is  another  area 
for  further  investigation.  A  better  taxonomy  of  types  of  purchase  problems 
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is  clearly  needed,  preferably  one  that  would  allow  us  to  define  objective 
problem  for  services. 

C omp la ir. t  I! ai v\ lip g  Uvlexes 

Initial  problems  are  sometimes  resolved  by  sellers'  complaint 
handling  mechanisms.  Table  :  presents  two  indexes  showing  levels  of 
dissatisfaction  with  these  mechanisms.   The  question  of  how  these  indexes 
might  be  combined  with  those  its  Table  1  will  be  discussed  below. 


Table  2  about  here 

The  first  set  of  data  in  Table  2  are  index  values  showing  the  relative 

frequency  with  which  voiced  complaints  were  not  Datisfactorily  resolved  by 

5 
sellers'  complaint  handling  mechanisms. 

Here  we  see  that  not  only  are  the  repair  services  major  sources  of 
consumer  problems,  their  complaint  handling  is  the  poorest  as  perceived  by 
our  respondents,  with  appliance  repair  complaint  handling  by  far  the  worst. 
And,  age in,  we  3se  that  television  sets,  calculators  and  tires  not  only  have 
infrequent  problems  but  also  have  relatively  more  effective  complaint  handling 
mechanisms.  Our  speculation  that  consumers  may  perceive  the  toy  industry  as 
poor  complaint  handlers  is  not  borne  out  r>y  the  data  wl  ich  give  it  far  and 
away  the  best  ranking 

The  second  set  of  date  in  Tall  >  2  computes  the"  frequency  with  which  all 
non-price  problems  are  unsatisfactorily  resolved.  Unsatisfactorily  resolved 
problems  include  those  not  voiced  =is  well  as  those  where  the  complaint 
handling  process  was  not  fully  satisfactory.  Again  the  difference  between 
this  set  of  data  and  the  first  set  is  a  function  of  differences  in  voicing 
rates,  differences  that  move  the  toy  industry  from  best  to  worst  in  the 
rankings.  It  may  be  noted,  however,  that  as  expected,  the  second  set  of 


These  calculations  exclude  problems  whose  resolution  is  stil3  pending. 
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indexes  have  a  narrower  range  than  the  first  with  only  toys  and  appliance 
repairs  more  than  r,ix  percentage  points  from  the  group  average. 

Final  Dissatis fa ction 

If  one  is  to  develop  an  overall  measure  of  final  dissatisfaction  levels 

as  the  taxonomy  in  Figure  2  proposes,  how  are  initial  indexes  to  be  combined 

with  indexes  of  complaint  handling  performance?  One  obvious  alternative  is 

simply  to  reduce  the  number  of  initially  unsatisfactory  purchases  (by  some 

definition)  by  the  numbsr  that  were  communicated  to  sellers  and  satisfactorily 

resolved.  An  example  of  such  a  set  of  data  is  found  in  Table  3  which  repor 

indexes  of  the  frequency  with  which  all  purchases  result  in  non-price  pro- 
is 

blems  that  are  not  satisfactorily  resolved/   Here  one  sees  that  the  resulting 
indexes  parallel  very  closely  those  in  the  second  set  of  data  ("non-price 
problems")  in  Table  1.  This  is  primarily  because  satisfactorily  resolved  non- 
price  problems  ars  only  about  seven  percent  of  all  purchases.   The  two 
exceptions  in  this  comparison  are  bicycles  whose  index  improves  and  toys 
whose  index  significantly  worsens,  which,  as  we  have  seen,  is  largely  due 
to  a  low  voicing  rate.   Policy  makers  under  some  circumstances  may  wish  to 
give  greater  weight  to  complaint  handing  performance  in  future  final 
OS/2   s  20  ies. 

>le  3  abou 


The  indexes  in  Table  3  can  be  approximated  by  multiplying  the  indexes 
in  column  2,  Table  1  and  column  2,  Table  2,  Differences  appear  due  to  the 
fact  that  the  base  in  column  2  in  Table  1  does  not  delete  pending  cases  as 
does  the  has*  in  fable  3. 
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SUMMARY  AND  CONCLUSIONS 

This  paper  has  presented  a  taxonomy  of  consumer  satisfaction/dissatis- 
faction measures  and  produced  empirical  data  for  four  of  the  eight  categories. 
The  empirical  analyses  suggest  the  following  conclusions: 

1.  S-imple  initial  sul  ;  ctive  satisfaction  (or  dissatisfaction) 
scales  have  at  least  two  important  biases :  they  underreport 
actual  problems  and  they  often  reflect  consumer  concerns  with 
high  prices. 

2.  Unsolicited  complaints  data  do  not  yield  very  accurate  pictures 
of  the  rate  of  perceived  non-price  problems  in  the  consumer  world 
primarily  because  of  different  rates  at  which  problems  are  com- 
municated to  sellers.  Thus,  field  surveys  to  gather  basic  CS/D 
data  seem  unavoidable. 

3.  Measures  of  "objective"  problems  await  a  better  taxonomy  of 
problem  types,  especially  for  services. 

4.  Performance  on  initial  product /service  satisfactions  scales  may 
not  always  be  reflected  in  equal  (good  or  bad)  performance  for 
complaint  handling  meehanibms. 

5.  Final  measures  of  satisfaction  or  dissatisfaction  are  likely 

to  bo  heavily  weighted  by  J.nitial  CS/D  results  unless  differen- 
tial weighting  is  applied  to  complaint-handling  performance. 
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RECOMMENDATIONS 

Among  the  scales  for  which  empirical  data  were  available,  the  initial 
non-price  problems  scale,  the  unsatisfied  non-price  voiced  complaint  scale 
and  the  combination  of  the  two  in  a  final  dissatisfaction  scale  seem  superior 
for  their  relative  lack  of  ambiguity  and  ease  of  accumulation  in  a  field  sur- 
vey.  It  is  possible,  however,  that  further  work  on  "objective"  problem  scales 
will  produce  better  measures  in  the  future.   In  the  interim,  efforts  to 
evaluate  the  retest  reliability  of  the  present  scales  are  essential  as  are 
efforts  to  evalute  them  at  different  levels  of  purchase  aggregation. 

Finally,  note  should  be  made  of  the  fact  that  in  the  recommended  scales 
any  one  problem  was  considered  as  important  as  any  other.  Future  scholars 
ought  to  consider  the  possibility  of  weighting  these  data  by  one  or  more  of 
three  factors:  (l)  the  subjective  or  objective  importance  of  the  purchase, 
(2)  the  subjective  or  objective  seriousness  of  the  problem,  and  (3)  the 
extent  to  which  the  household  with  the  problem  may  be  considered  disadvan- 
taged.  One  :an  conceive  of  numerous  policy  matters  fo^  which  such  weightings, 
if  they  can  be  obtained,  would  prove  highly  relevant. 
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Delighted    Pleased    Mostly     Mixed      Mostly    Unhappy     Terrible 
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FIGURE  3. 


SCALE  USED  IN  ASSESSING  AFFECTIVE  RESPONSES 


From:  Frank  M,  Andrews  and  Stephen  E.  Witney,  "Developing  Measures  of 
Perceived  Life  Quality:  Results  from  Several  National  Surveys," 
Social  Indicators  Research  1  (1974),  p.  11. 


The  performs*!™  of  your  calculator: 

a.  How  good  is  it  new? 

(min. )   1    2    3    4    5    6    7   (max. ) 

b.  How  good  did  you  expect  it  to  be? 

(min.)       12         3^567       (max.) 


FIGURE  i*. 


SAMPLE  DERIVED  DISSATISFACTION  SCALE 


Adapted  from!  Philip  Kotl; :-r,  Marketing  for  Non-Frofit  Organizations, 
(New  York:  Prentice-Hall ,  Inc..  1975),  p. 


TABLE  1 


INITIAL  DISSATISFACTION  INDEXES 


Car  Repairs 

Appliance  Repairs 

Home  Repairs 

Toys 

Car  Purchase 

Eyeglasses 

Bicycle 

Television  Set 

Calculator 

Tires 


Dissatisfaction 


Index  Rank 


153 

1 

152 

2 

129 

3 

105 

4 

96 

5 

38 

5 

70 

7 

66 

8 

62 

9 

41 

10 

Non-  Price 
Problems 

Index  Rank 


137 


116 

b 

110 

5 

119 

3 

125 

2 

81 

7 

96 

6 

30 

8 

b6 

9 

i      10 


Voiced  Non- 

Price  Problems 

Index 

Rank 

157 

1 

150 

2 

137 

3 

53 

9 

135 

4 

87 

7 

9'4 

5 

91 

6 

60 

8 

40 

10 

"Objective" 

Problems 

Index  Rank 


\ 


Assumed 


*      1,  2  § 


/ 


95 

7 

232 

4 

18 

10 

107 

6 

152 

5 

83 

8 

46 

9 

Base 


:gj 


1C0 


100 


100 


No.  of  Cases 


(7372) 


(7453) 


(7351) 


(5137) 


TABLE  2 


COMPLAINT  HANDLING  INDEXES 


Car  Repairs 

Appliance  Repairs 

Home  Repairs 

Toys 

Car  Purchase 

Eyeglasses 

Bicycle 

Television  Set 

Calculator 

Tires 


Not  S; 
Non- 
Voiced  ( 

atisfied 

-Price 

Complaints 

Not  Satisfied 
Non-Price 
Problems 

Index 

Rank 

Index 

Rank 

105 

2 

100 

6* 

141 

1 

110 

2 

100 

3* 

100 

8* 

67 

10 

120 

1 

94 

5 

99 

9 

3* 

100 

6* 

93 

6 

101 

5 

85 

9 

95 

10 

92 

7 

105 

4 

89 

8 

106 

3 

Base 


100 


100 


No.  of  Cases 
*tie 


(917) 


(1942) 


TABLE  3 


FINAL  DISSATISFACTION  MEASURES 


lot  Finally 
Satisfied  Purchases 


Car  Repairs 

Appliance  Repairs 

Home  Repairs 

Toys 

Car  Purchase 

Eyeglasses 

Bicycle 

Television  Set 

Calculator 

Tires 


Index 

Rank 

131 

2 

122 

3* 

110 

5 

134 

1 

122 

3* 

77 

7 

80 

6 

73 

8 

65 

9 

46 

10 

Base 


100 


No.  of  Cases 


(7369) 


*tie 


